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SHARP ASYMPTOTICS OF THE FUNCTIONAL QUANTIZATION 
PROBLEM FOR GAUSSIAN PROCESSES 

By Harald Luschgy and Gilles Pages 
Universitdt Trier and Universite Paris 6 

The sharp asymptotics for the I/ 2 -quantization errors of Gaus- 
sian measures on a Hilbert space and, in particular, for Gaussian 
processes is derived. The condition imposed is regular variation of 
the eigenvalues. 

1. Introduction. The quantization of probability distributions is an old 
story which starts in the late 1940s. It has been conceived in order to drasti- 
cally cut down the storage of signal data to be analyzed. For a comprehensive 
survey of the theory of quantization, including its historical development, 
we refer to Gray and Neuhoff (1998). For the mathematical aspects of quan- 
tization, one may consult Graf and Luschgy (2000), and for more applied 
aspects in the field of information theory and signal processing, the book of 
Gersho and Gray (1992) is appropriate. 

However, only recently rigorous extensions to the functional quantization 
of continuous-time stochastic processes have been obtained for the Gaus- 
sian case. See Luschgy and Pages (2002), Dereich, Fehringer, Matoussi and 
Scheutzow (2003), Dereich (2003) and Graf, Luschgy and Pages (2003). 
In particular, the order of convergence to zero of the quantization error 
has been investigated. The main result of this paper is the sharp asymp- 
totics of the L 2 -quantization error for a large class of Gaussian processes 
in a Hilbert space framework. This makes the high-resolution theory in this 
setting as precise as in the finite-dimensional theory. 

The framework can be stated as follows. Let X be a centered Gaussian 
random vector defined on a probability space taking its values in a 

real separable Hilbert space H with scalar product (•, •) and norm || • ||. The 
distribution Px of X will be denoted by P to simplify notations. For n G N, 
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the L 2 -quantization problem at level n consists in minimizing 

Emm \\X — all 2 

over all sets a C H with \a\ <n, where | • | is for cardinality. The minimal 
nth quantization error of P is then defined by 

(1.1) e n = e n (P) =inf|^min||X - a\\ 2 ^j 1 :a C if, 1 <\a\ <n 

The L 2 -error is the most common measure of the performance of a quanti- 
zation or lossy data compression system mainly for its simplicity. 

Let a C H be a codebook with \a\ < n. One easily shows that the best 
approximation of X by an a-valued random vector is achieved by applying 
the rule of the nearest neighbor which corresponds to the geometric object 
called Voronoi partition. So, if 

where {A a :a€ a} is a Borel measurable partition of H such that, for every 
€ a, A a is contained in the (closed and convex) Voronoi region 



a 



then 



< x £ H :\\x — a\\ = min||x — 6|| >, 
i b£a "J 



E\\X - f(X)f = EmmllX 



Thus one arrives at the representation 

(1.2) e n = inf(^||X -fpOH 2 ) 1 / 2 , 

where the infimum is taken over all n-quantizing rules /, that is, Borel 
measurable maps / :H — > H with \f(H)\ < n. 

We address the issue of high-resolution quantization, that is, the per- 
formance of n-quantizers and the behavior of e n as n — > oo. Denote by 
Kp C H the reproducing kernel Hilbert space (Cameron-Martin space) 
associated to P. Observe that supp(P) coincides with the closure of Kp. 
Let Ai > A2 > • • • > be the ordered nonzero eigenvalues of the covariance 
operator of P (each written as many times as is its multiplicity) and let 
{uj '■ j > 1} be a corresponding orthonormal basis of supp(P) consisting of 
eigenvectors. If d := dimKp < 00, then e n (P) = e n (®j =1 N(0, Aj)), the min- 
imal nth quantization error of &)j = i A/"(0, Xj) with respect to the ^-norm 
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on and thus we can read off the asymptotic behavior of e n from the 
high-resolution formula 

/ d \ fd \ l / 2d / j , 9 \ (d+2)/4 

(1.3) lim n 1 /^ (g)AA(0, A,) = ^d)^ \{ Xj * 



^=1 / Vj=l 



d 



where g(d) is a constant in (0, oo) depending only on the dimension d [Zador, 
see Graf and Luschgy (2000)]. Except in dimension d = 1 and d = 2, the true 
value of q{d) is unknown. 

Now assume dimfCp = oo. Consider the Karhunen-Loeve expansion 



(1.4) X = ^) /2 Z 3 u 



1/2 

where Zj = (X,Uj)/Xj , j > 1, are i.i.d. Af(0, l)-distributed random vari- 
ables. [It is known that the Karhunen-Loeve basis is optimal for quantization 
of Gaussian measures, see Luschgy and Pages (2002).] Optimal quantization 
of X at level n consists in approximating it by a certain finite number 
d = d(n) of coefficients and the n-quantization of these coefficients. More 
precisely, let g:~R d — >M d denote an n-optimal quantizer for ®y = i A/"(0, Xj) 
and set 



f n (X) := ^2(g(X{' Zx, xYz d )) 3 u r 



Then 



e 



2 



E\\X - f n (X)\\ 2 = A i + e « 



j>d{n)+l 




[see Luschgy and Pages (2002)]. The critical dimension d{n) is small when 
compared with n but otherwise unknown for n > 3. [Since d(n) < n — 1, we 
have d(l) = and d{2) = 1.] 

In this paper we improve some of the results in Luschgy and Pages (2002) 
and derive the sharp asymptotics of e n as n — > oo analogously to the finite- 
dimensional case (1.3) and with slower rates than any n~ a , of course (The- 
orems 2.1 and 2.2). This is achieved for regularly varying eigenvalues. The 
result obtained is even better than (1.3) since limiting constants can be eval- 
uated. 

A simple way of obtaining compression is product quantization. Here the 
Karhunen-Loeve coefficients are individually quantized. Thus considering 

m(n) 
.7=1 
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where m = m{n) 6 N is suitably chosen and gj : R — > R are rtj-optimal quan- 
tizers for A/"(0, 1) with optimally allocated rij G N such that n^ =1 rtj < n, 
we further show that, for regularly varying eigenvalues with index —1 (the 

largest possible index i.e. the slowest possible decrease), f n is asymptoti- 
cally optimal. This means that 

e 2 

hm \ = 1. 

Furthermore, one shows that — f n (X)W 2 ) 1 / 2 does follow a sharp rate 

of convergence as n — > oo which in turn is that of e n (see Theorem 2.1). 
When the eigenvalues are regularly varying with index — b < — 1, it turns 

out that some product quantizers fffi with a similar structure but based on 
quantizing d-dimensional marginal blocks are asymptotically almost optimal 
for some large values of d and provide sharp asymptotics. Furthermore, it is 
to be noticed that, in that case, the above scalar product quantizers fn^ still 
achieve the sharp rate of convergence. The induced loss is (asymptotically) 
within a sometimes small constant multiple of the minimal quantization 
error. These results are stated in Theorem 2.2. 

A famous notion of information theory is Shannon's (1949) e-entropy 
(rate-distortion function) of P. For e > 0, it is defined by 

R(e) = R P (e) 

= inf <H(Q\P ®Q 2 ):Q probability 

(1.6) 

on H x H with first marginal Q\ = P 
and / ||, -,f *)(.,»)<<>}, 
where H(Q\P (g> Q2) denotes the relative entropy (mutual information) 




if Q is absolutely continuous with respect to the product of the marginals 
P <8> Q2 and equals to 00 otherwise. The simple converse part of the source 
coding theorem [cf. Berger (1971), Theorem 3.2.2, and Graf and Luschgy 
(2000), page 163] says that the minimal number N(e) of codewords needed 
in a codebook a such that Emm aea \\X — a|| 2 < e 2 satisfies 

logJV(e) > R(e). 

[In particular, note that R(e n ) < logn.] As an application we obtain that 
logA^(e) is precisely R(s) in the small distortion regime, that is, 

ii m « = i 

e^o Re) 
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(Corollary 2.4). This sharp asymptotics of the rate of log N(e) is also touched 
by Donoho (2000). 

A further application concerns the small ball problem and its relation to 
Shannon's e-entropy. 

The paper is organized as follows. In the next section we state the results 
outlined above. Section 3 contains a collection of examples. Section 4 is 
devoted to the proofs. 

Throughout, all logarithms are natural logarithms and [x] denotes the 
integer part of the real number x. 

2. Statement of results. Now we formulate sharp asymptotic results for 
the nth quantization errors c n — € n (-P) and determine the asymptotic behav- 
ior of the optimal product quantizers fn^ as n — > oo for centered Gaussian 
measures P with dim Kp = oo. It is convenient to use the symbols ~ and <, 
where a n ~ b n means a n /b n — ► 1 and a n < b n means limsup n a n /6 n < 1. 

Let us first give a precise definition of fn^ . Given n, m G N, let n\, . . . , n m G 
N with IFjL^j < n and let gj :R— >M be n^-optimal quantizers for jV(0, 1), 
je {!,... ,m}. Set 



m 



f( x ) = J2 xl / 2 9j( x j) u 



xeH, 



where Xj = (x,Uj)/X- . Then |/(-ff)| < n and, for every m G N, 



in 



E\\X-f(X)f= £ A, • Y^XjEiZ, ^Z,)) 1 



j>m+l j=l 



in 



= E A,+^A jenj (AA(0,l)) 2 



j>m+l j=l 



m 



< £ A J + C(l)5>n- 2 , 



j>m+l j=l 



where 



C(l) :=supA: 2 efc(AA(0,l)) 2 



fe>l 



is a universal constant. 



By the Zador theorem [cf. (1.3)], C(l) < oo. Finally, 
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We may first optimize the integer bit allocation given by the n'jS for a given 
m and then select some m = m(n) (hopefully close to the optimal one). To 
this end, first note that, for a fixed m £ N, the continuous bit allocation 
problem reads, for every n £ N, 

( m m \ m / m \ l/ m 

mf x: \vf -vi > o, n V, < n = e v,~ 2 = ^ _2/m ^ n ^ , 



Lj=l j=l J j=l \j=l 



with 



Z-j 



-l/2m 



Vj=l 



One can produce an integer-valued (approximate) solution by setting rij = 
[zj] provided all Zj > 1. In fact, since the sequence (Aj) is nonincreasing 

01 > ■ • ■ > z m , so one simply needs that z m = n 1 ^ m Xm 2 (Il'jL m Xj)~ 1 / 2 ' m > 1. 
A natural choice for the dimension m is then 

(- / k \ -1/2A; i 

(2.1) m = m(n):= max <^>l:n 1/fc A* /2 M] A i ^ X f' 



n^Af IlA 



\j=i 

-l/2m- 



'J 

i=l 



j 6 {!,..., m}, 



(2.2) n,- = rij(n) :- 

m(n) 

(2.3) /«(*) := ]T A] V'^",- x £ H. 

j'=i 

We need the notion of a regularly varying function. A measurable function 
y : (s,oo) — ► (0, oo) (s > 0) is said to be regularly varying at infinity with 
index b £ R if, for every t > 0, 

ip(tx) h 
lim -i-V^r = t ■ 

Regular variation of ip : (0, s) — > (0, oo) (s > 0) at zero is defined analogously. 
Slow variation corresponds to b = 0. 

Theorem 2.1. Assume Xj ~ (p(j) as j — > oo, where <p : (s, oo) — > (0, oo) 
is a decreasing, regularly varying function at infinity of index —1 for some 
s > 0. Set, for every x > s, 

Then 

e n ~ - /«(A0|| 2 ) 1/2 ~ ^(logn)" 1 / 2 as oo. 
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Moreover, 

rre(n) ~ 2 log re. 

Remark 2.1. Since J2j^=i < oo, the integral f£° tp(y) dy is finite. Ob- 
serve also that the above function ip is slowly varying at infinity [see Bing- 
ham, Goldie and Teugels (1987), Proposition 1.5.9 b]. The most prevalent 
form for ip is 

ip(x) = cx~ x (log x)~ a , a>l,c>Q,x>l. 
Then ip(x) = (a — l)(logx) a_1 /c and hence 

e n ~ (E\\X - /«(X)|| 2 ) 1/2 ~ (^y) ^(loglogn)"^ 1 )/ 2 as rw oo. 

The following theorem is devoted to the case of regularly varying eigen- 
values with index — b< — 1. It includes a wide class of Gaussian processes. 
As mentioned in the Introduction, the sharp asymptotics for e n in item 
(a) is now approximately achieved by (i-dimensional marginal block product 
quantizers. They will be more precisely defined further on in the proof [see 
(4.1)-(4.3) in Section 4]. Asymptotic optimality is obtained for some high 
values d of the marginal block dimension. Furthermore, we show in item (b) 
that, although no longer asymptotically optimal like in Theorem 2.1 (setting 

—b = —1), the scalar product quantizers f'n^ as defined in (1.5) still provide 
the sharp rate of convergence to for e n . 

Theorem 2.2. Assume Xj ~ ip(j) as j — > oo, where tp : (s, oo) — ► (0, oo) 
is a decreasing, regularly varying function at infinity of index —b < — 1 for 
some s > 0. Set, for every x > s, 

i>( x ) : = — 7-T- 

X(f(X) 



(a) Sharp asymptotics for e n . Then 



i> (log n)~ 1/2 



as n — > oo. 



6-1. 

(b) Asymptotics of the scalar product quantizers fn ■ Moreover, 

21ogre 
rre(re) ~ — - — 

and 

(E\\X-fM(X)\\ 2 f 2 

<(Q) 6 1 (^ T +4C(l))V / %(logn)- 1 /2 asn^oc, 
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where the real constant C(l) is given by (2.1). 



The proof combines finite-dimensional quantization theory and Shannon's 
rate-distortion theory. 

Remark 2.2. (i) We obtain from Theorem 2.2 



(E\\X-fj l \x)\\ 2 y/ 2 < ^1 + 4C(1)(6-1)V/ 2 



as n — > oo. 

b J 

So, if the index b is close to 1, fn is close to asymptotic optimality. The 
constant C(l) is lower bounded by 

lim k 2 e k (Af{0, l)) 2 = — = 2.7206 . . . 

k^oo 2 

[see Graf and Luschgy (2000), page 124]. There is strong numerical evidence 
for C(l) = :y y ZE . We computed upper bounds of ek(M(0, l)) 2 using the m-- 
quantiles, i £ {1, . . . , k}, of jV(0, 3) which are known to be asymptotically 
optimal. We thus found 

sup fc 2 e fc (AA(0,l)) 2 <^. 

l<fc<1000 * 

This suggests that the product quantizing rule cannot be dramatically 
improved upon for regularly varying eigenvalues, 
(ii) The most prevalent form for (p is 

tp(x) = caT fe (log x)~ a , b> l,aeM,x>max{l,e~ a/b }. 

Then we have from the above that 

^ ( C Q) 6 1 7^Y) 1/2 ( lo g")^ (6 ~ 1)/2 ( 1 °g lo g n )~ a/2 as n^oo. 

A useful equivalence principle can be deduced from the preceding theo- 
rems. 

Corollary 2.3. Assume the situation of Theorem 2.1 or 2.2. Let V and W 
be centered Gaussian measures on H and assume that dimsupp(y) < oo and 
W is equivalent to P* V . Then 

e>n(W) ~ e n (P) asn^oo. 
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Now we consider, for e > 0, 
(2.4) N(e) :=min{n> l:e„<e}, 

and the announced strong equivalence of \ogN(e) and R(e). The following 
"flooding" formula for the e-entropy R(e) of Gaussian measures was orig- 
inally given by Kolmogorov (1956) [see also Ihara (1993), Theorem 6.9.1]. 
For < e < ei = Xj) 1 / 2 , let 



(2.5) r = r(e) := max<j k > 1 : ^ Xj + kX k > e 2 

j>k+l 



and let ■& = $(e) £ X r ) be uniquely defined by 



e 2 . 



(2.6) x j + r $ 

j>r+l 

Then YOjLi min{A i ,'!?} = e 2 and 

(2.7) R(e) = i^log(Aj/i9). 

i=i 

The "reproducing distribution" Q2 = £?2(e) = ^ Y is given by 



(2.8) Y = Y(e) := £ \xf (l - 1) Zj + ^ (l - ±) Z> 



where Z[,Z' 2 ,... are i.i.d. A/(0, l)-distributed random variables indepen- 
dent of (Zj)j>i, since Q = Q( £ ) ■= p( x > y ) solves the minimum problem in 
Shannon's R(e), that is, R(e) = H(Q\P ® Q 2 )- 

Corollary 2.4. Assume the situation of Theorem 2.2. Then 
logiV(e) ~i?(e) ase^O, 
i?(e n ) ~ logra, 
21og?i 

r(e n J ~ — - — asn— > oo. 
Furthermore, R is regularly varying at zero with index —2/(6 — 1). 

Remark 2.3. (i) Donoho (2000) states logiV(e) ~ R(e) for eigenvalues 
Xj ~ j~ b with 6 > 1 and argues that this sharp asymptotics is a consequence 
of Shannon's rate-distortion theory. Our proof of (the more general) Corol- 
lary 2.4 is not in the range of the Shannon theory (see Remark 4.1) and 
therefore, it does not support Donoho's assessment. 
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(ii) Let f n be an n-optimal quantizer for P. Then, under the condition 
of Theorem 2.2, 

entropy(P^ n ) ~ logn as n — > oo. 

This follows from the above result, since 

R{^n) < entropy (P^' 1 ) < logn. 

(hi) Since r(e n ) = dimsupp(Q2(e n ))) the number r(e n ) plays the role of 
a dimension of the level-n quantization problem. The same role is played 
by m{n) for the level-n product quantization problem. By Theorem 2.2 and 
Corollary 2.4, we have m(n) ~ r(e n ). 

(iv) In case Xj ~ cj~ b (log j)~ a with c > 0, b > 1 and a£R, the Shannon 
e-entropy can be computed as 

m ~ \ ( """V^ wm-^ — o 

[see, e.g., Binia (1974) and Luschgy and Pages (2002); cf. also (4.14)]. 

(v) In Shannon information theory is also introduced the distortion-rate 
function 

D{R) := inf | (j \\x - y\\ 2 dQ(x,y)^j ^ , 

Q probability on H x H, Qi = P and H(Q\P® Q 2 ) < 

where H(Q\P (8) Q2) classically denotes the relative entropy information 
as defined in the Introduction. One easily checks that it always satisfies 
D(logn)<e n . Furthermore, under the assumptions of Corollary 2.4, one 
shows as for the rate-distortion function that 

D(logn)~e n as n -> 00. 

A further application concerns the small ball problem where one tries to 
find the asymptotic behavior of the function 

(2.9) F(e) = -logP(pr||<e) 

for small e > 0. The Shannon e-entropy provides an upper bound. 

Corollary 2.5. Assume the situation of Theorem 2.2. Then 
F(e) < R(e) as e -> 0. 
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Remark 2.4. Under the same condition as above, the lower estimate 
/ b \ 6/(6-1) 

follows from Theorem 2.5 in Dereich (2003). Simple examples (e.g., Brownian 
motion and H = L 2 ([0, 1], dt)) show that neither F(e) ~ R(e) nor F(e) ~ 
(_|_)6/(6-i) jR ( £ ) as e _> o is true. 

3. Examples. We consider centered L 2 (P) -continuous Gaussian processes 
X = (X t ) ta with / = [0, l] d . Then X can be seen as a centered Gaussian 
random vector with values in the Hilbert space H = L 2 (I,dt). 

3.1. Stationary Gaussian processes, Ornstein-Uhlenbeck process and frac- 
tional Ornstein-Uhlenbeck processes. Let X = (X t ) t £[o,i] be a centered sta- 
tionary Gaussian process (restricted to [0, 1]) with covariance function C(s, t) = 
7(s — t), where 7 : R — > R is continuous, symmetric and positive definite. As- 
sume that the spectral measure admits a (symmetric) Lebesgue density h 
so that 

C(s,t)= f e iX{t - s) h{\)d\= ( cos(A(t- s))h(X)dX. 

JR JR 



Theorem 3.1 [Rosenblatt (1963)]. Under the condition heL 2 (R,dX) 
(where d\ denotes the Lebesgue measure on the real line) and the high- 
frequency condition 

(3.1) h(\)~c\~ b as X^ +00 

for some c > 0, b > 1, the asymptotic behavior of the eigenvalues of the 
covariance operator is as follows: 

(3.2) Xj ~ 2cK-^ 1] r b as j 00. 
Therefore, 

/ / j, \ 6-1 h \ 1/2 

(3.3) e n ~(2c(J-) (logn)-(^ 1 )/ 2 asn^oo. 

Condition (3.1) comprises a broad class of one-dimensional processes in- 
cluding processes with rational spectral densities, the Matern class [see the 
discussion in Stein (1999)] and fractional Ornstein-Uhlenbeck processes (but 
excludes, e.g., bandlimited processes). 

The fractional Ornstein-Uhlenbeck process with index p £ (0, 2) corre- 
sponds to 

C(s,t) = exp(-a|s - t\ p ), a > 0. 
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The spectral measure of this process is a symmetric p-stable distribution. 
Its Lebesgue density h is (symmetric) continuous and satisfies 

h{\) ~ c\~ (1+p) as A — ► +00 

with 

aT(l + p) sin(7rp/2) 
c= , 

7T 

where T denotes the gamma function. Consequently, 

(3.4) V " M2 ' ; 

as n — > co. 

If p = 1, one gets the standard stationary Ornstein-Uhlenbeck process on 
[0, 1]. In this case, 

(3.5) e n (0[/)~^(logn)- 1 / 2 as rw 00. 

3.2. Brownian motion, integrated Brownian motions, Gaussian diffusions 
and fractional Brownian motions, (i) Brownian motion. Let B = (_B t ) te r 01 i 
be a standard Brownian motion. Its covariance operator has eigenvalues 

A fc = (vr(A:-i))- 2 , k > 1. 

This gives 

/2 

(3.6) e„(M) ~ — (logn)~ 1/2 asn^oo. 

7T 

(ii) m-integrated Brownian motion. For m 6 N, let X = {Xt)t&\o,l\ be m- 
times integrated Brownian motion: 

rt rs m rsi 

X t = / • • • / B S1 dsi ■ ■ ■ ds m 



JO 



(m-iy.Jo 
Its covariance function reads 



i- At-.)-*.*. 



1 /-sAt 

C(s,t) = 7Z ^l_ ( S -rr(t-rrdr. 







(m!) 5 

Ritter (2000, page 79) [see also Freedman (1999) for m = 1 and Gao, Hanning 
and Torcaso (2003)] has derived the asymptotic behavior of the eigenvalues 
of the covariance operator: 

A fc ~ (7rk)-( 2m+ V as k 00. 
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Theorem 2.2 then implies that 

(3.7) en (/5M m )~ 7 r-(-+ 1 )(m + ir +1 / 2 f^^y /2 (logn)-(-+ 1 /2) 

\2m + 1/ 

The general m-times integrated BM as considered by Gao, Hanning and 
Torcaso (2003) exibits the same asymptotics of the eigenvalues and hence 
of e n . 

(iii) Gaussian diffusion. Next, let X be the unique solution of the equa- 
tion 

dX t = A(t)X t dt + dB t , X = £, te[0,l], 

where A G L 2 ([0, l],dt) and £ is Af(0, cr 2 )-distributed with a 2 > and inde- 
pendent of B. We find the same asymptotics as for B: 

^ n \-i/2 
e n ~ — (lognj ' as?i^oo. 

7T 

This follows from Corollary 2.3. One only has to note that in case a 2 = 
(i.e., £ = 0), the distribution of X is equivalent to the Wiener measure, and 
in case a 2 > 0, it is equivalent to the distribution of £ + B. 

(iv) Fractional Brownian motion. The fractional Brownian motion (FBM) 
with Hurst exponent (3 G (0,1) is a centered continuous Gaussian process 
on [0, 1] having the covariance function 

C( s ,t) = ^ + ^-\s-t\^). 

Using the spectral representation 

C(s,t) = jf (1 - e- A )(l - e - ux )j^d\, 

where 

1 _ r(l + 2^)sin(7r/3) 

C ~ 4/ oo (l-cosA)A-( 1 + 2 / 3 ) dA ~ 2^ ' 

one shows the following proposition. 

Proposition 3.2. The ordered eigenvalues of the FBM covariance op- 
erator satisfy 

A fe ~ 2 CT - 2/3 fc- (1+2/3) as k -» oo. 

Proof. A different proof has been found independently by Bronski 
(2003). For the sake of simplicity we denote by the same letter C a co- 
variance function and its associated kernel operator. The method of proof 
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consists in checking that the eigenvalues of the covariance operator C of the 
FBM are (strongly) equivalent to those of the stationary covariance kernel 



C (s,t) = I e ^-^_^-dA. 



i,i]° l A l 



1+2/3 



Then, the announced result follows straightforwardly from (3.2) since Ao, ra ~ 
2c7r -2/3 n - ( 1+2 ^) as n — > oo. To show this equivalence, we will rely on the 
following comparison lemma [see, e.g., Rosenblatt (1963)]. □ 

Lemma 3.3. Let A\, Ai be two symmetric completely continuous trans- 
formations on a Hilbert space H . Denote the nth nonnegative eigenvalue 
of Ai, i = 1,2, and A\ + A% by Xf n and A+, respectively, and the nth non- 
positive eigenvalue of Ai, i = 1,2, and A\ + A2 by X^ n and X~ . Then, for 
every n, m>l, 

(3.8) K+m-l - \n + \m and ^ \n+m-l + A 2,n 



First, we decompose C := C — Cq as follows: 

C(s,t) = C 1 (s,t) + C 2 (s,t) 



with 



and 



Ci(s,t):=Sfte / (l-e- isX )(l-e ltx )n(d\) 



C 2 (s,t):= / (l-cos(tA)-cos(sA))//(d\), 

J[-l,l]° 

where (i(d\) := [rm^e dX. 

The operator C\ is nonnegative so Ai jn = A^ n , n > 1. The range of opera- 
tor C2 has obviously dimension 2 since it maps L 2 ([0, l},dt) onto (1,7) with 
j(t) := f 1 1 c cos(iA) fj,(dX) . Hence Af m = as soon as m > 3 and it follows 

from inequalities (3.8) that, for every n > 3 

Ai, n +2 < Xfn < Ai jn _2 and A l n = 0. 
To estimate the eigenvalues Ai jn of the operator C±, one first notes that 

Ci( S| t) = -2c V ^H* 2fc + t 2fc - (a - tf k ) f 1 X 2 ^- 1 dX 

K>1 ( 2k > ] J ° 

= - c V f s 2fc + t 2fc - fa - t) 2fc ) 

C fc ^ 1 (2A ; )!(fc-/3) (S +t [S t] } 



FUNCTIONAL QUANTIZATION 15 
- c V i— (s 2k + t 2k -(s-t) 2k ) 



= :Ci,„(s,t) 

+ ( -^>? +1 (fe (s2t + t2l - (S - (,2t) - 

" v ' 

One checks that C\ n maps L 2 ([0, 1], dt) into the (2n — 1) -dimensional 
space M 2 ( n _i) [X] of polynomial functions P such that degree(P) < 2(n — 1). 
The above lemma implies that 



Ai,2n<A+ } 2n + A' ( + n) jl = A' ( | } = sup / C{ (s,t)u(s)u(t)dsdt. 

y ' y ' K ' ||u||=l J[0,1] 2 

Now, using that \s 2k + t 2k - (s - t) 2k \ < 3 for every s, t G [0, 1], one easily 
derives that 



■i - 1 3c \ - 1 



< 



! 

" fc>2(n+l) 

3c 1 3c 1 



n + l-/3(2n + l)(2n + l)! 2n 2 (2n + l)!' 

The sequence (Ai in ) n >i being nonincreasing, it follows that Ai jn = o(Ao,n) 
and consequently A+ = o(Ao, n )- Finally, one derives the announced conclu- 
sion from the equality C = Co + C and inequalities (3.8) of the lemma: 

An = A+ = A , n + o(Ao,n) as n — >• oo. 

This yields 

(3.9) V * M! ' ; 

as 7i — ► oo. 

It is interesting to observe that the quantization error of the fractional Brow- 
nian motion exhibits the same asymptotic behavior as that of the fractional 
Ornstein-Uhlenbeck process with covariance exp(— \s — t\ 2 ^/2). 

3.3. Gaussian sheets. We consider centered (L 2 (P)-continuous) Gaus- 
sian fields X = (Xf) t £t ijd with covariance function of tensor product form 

d 

C(s,t) = Y[C j (s J ,t j ), 

3=1 
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where Cj are covariance functions on [0,1]. Let Ai(j) > A2O) > ••• > 
and Ai > A2 > • • • denote the ordered nonzero eigenvalues associated to 
Cj and C respectively. We rely on the following proposition. 

Proposition 3.4 [Papageorgiou and Wasilkowski (1990)]. // Afc(j) ~ 
Cjk~ b as k — > c<3 for every j G {1, . . . , d}, where cj > 0, b > 1, then 



h~ (jlc^(d-l)\)- b k- b (logk) 



as k -> 00. 



• Fractional Ornstein-Uhlenbeck sheet. The fractional Ornstein-Uhlenbeck 
sheet on [0, l] d with index /)£ (0,2) corresponds to the following covari- 
ance function 

d 

C(s,t) = Y[ exp(— aj\sj — tj\ p ), aj > 0. 
3=1 

By Example 3.1 and Proposition 3.4, the eigenvalues of its covariance oper- 
ator satisfy 

\d~l \ l+p 

Afc ~ I I o,- I ( = v ~ ' r '"" y " ri ' \ ( \"°" , jN ,, ) as k — > 00. 



'A \f 2T(l+p) sin(vrp/2) \ d ( (log k) d ~ l 



Therefore, 

.1 \ 1/2 /9rCl +^) S iD('7rn/9 N l\ d / 2 



(3.10) x ((i±e) P i±e) 1/2 (logn)-'' 2 (loglog>i)l 1 +''ll''- 1 l/ 2 

as n — > 00. 

If p = 1, one gets the stationary Ornstein-Uhlenbeck sheet on [0, l] d . In this 



case 



/ d \ 1/2 2 (d+l)/2 

e n (Of/S) ~ ^ a, ) -^ 7 _ TT (logn)" 1 / 2 (loglogn)^ ] 



TT d (d- 1)! 

(3.11) 

as n — ► 00. 



The 2-parameter O.U. -sheet has been successfully used as model for image 
compression [see, e.g., Rosenfeld and Kak (1976)]. 
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• Fractional Brownian sheet. The fractional Brownian sheet with Hurst 
exponent f5 G (0, 1) is a centered continuous Gaussian field on [0, l] d having 
the covariance function 

C(s,t) = 2- d f[(sf + t^-\s J -t j n. 

By Propositions 3.2 and 3.4, the eigenvalues of th FBS covariance opera- 
tor satisfy 

T(l + 2/3) sin(^/3) w 



A fc > 



7T 



1+2/3 



((d-l)!)^ (1+2/3) fe-( 1+2 «(logA : )( 1 + 2 «( d - 1 ) 

as A; — > oo. 



This yields 
(3.12) 



r(l + 2/3) sin(7r/3) 



7T 



1+2/3 



d/2 



((d-l)!)-( 1+2 ^/ 2 



^) 2 "^) 1/2 (logn)^(loglogn)(^)^ 1 )/ 2 



as n — > oo. 



If /? = g, one gets Brownian sheet where 



In this case 
(3.13) e n {BS) 



V2 



C(s,t) = Y[(s J At j ] 

3=1 



(logn) 1//i: (loglogn 



,<2-l 



as n — > oo. 



7T d (rf- 1)! 

The same asymptotic behavior of the eigenvalues and subsequently of e n is 
obtained for the completely tucked Brownian sheet on [0, l] d , where 

d 

C(s, t) = T\ (sj A tj - Sjtj). 

3=1 

4. Proofs of results. We need an extension of the quantizing rule fn 
based now on quantizing blocks of Karhunen-Loeve coefficients of fixed block 
length d. Fix d,n£N and set Vj := A(y_iv+i, j > 1. Let 



(4.1) m = m(n, d) := max 

(4.2) rij = rij(n, d) : 



L>l:nV k v* /2 \ 



n 

k i=l 



n 

V=i 

-d/2m 



-d/2k 



>1 , 



j G {!,... ,m}, 
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and 

m d 

fi d) {x) := E E >\j-i)d + k(9j( x U-i)d+i,- ■ ■,x jd )) k u {j _ l)d+k , xeH, 
j=ik=i 

where gj :M, d — >M. d denotes an n^-optimal quantizer for N(0,I d ). Setting 
ZC?) := (Z(j_ 1)d+1 , . . . , Z jd ), we get 

m d 

(4-3) = E E ^! 1)(i+fe fe^ (i) )) fe n (i _ 1)d+fe) 

i=ifc=i 

rij > l,II^ =1 nj < n and |/^(77)| < n. For d>2, the procedure (4.3) is worse 

1/2 

than quantizing d-blocks of coefficients A,- Zj but good enough for our 
purpose. For the evaluation of the error of fn^ , we need the constant 

(4.4) C(d):=supk 2 / d e k (Af(0,I d )) 2 . 

k>l 

By the Zador theorem [see (1.3)], C{d) < oo. 

Lemma 4.1. For every d,n EN, 

E\\X-fW(X)\\ 2 < Yl \j + ± 1/d C(d)mv m 

j>md+l 

with m = m(n, d) from (4.1) and v m = \ m -u d +i ■ 
PROOF. We have 

m d 

E\\X-f^{X)\\ 2 = £ \ ] + Y J T.\^)d + kE{Z^ l)d+k -{g J {Z^)) k ) 2 

j>md+l j=lfc=l 
m 

< E x J + J2^ E \\ zU) -9^)\\ 2 

j>md+l j=l 
m 

= E ^+E^^(^(o,/ d )) 2 . 



Moreover, by (4.2) 



£^e n ,(jV(O l J < ,)) 3 <C(d)X;i/ i 

3=1 3=1 



2/d 

n 3 



C(d)5>(ry + l)- : 



3=1 
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/ m \ 1 / m 
<A l l d C(d)mn~ 2 l dm [\{v^ 

< 4 1/d C(d)mv m . □ 



A Shannon-type lower bound is as follows. 
Lemma 4.2. For every n G N, 

4 > Y + 



J>m+1 



with m = m(n) from (2.1). 
[Note that m(n) = m(n, 1).] 



Proof. Setting 



(4-5) « fc :=^log(^n A /) / = \ E MV**). 

we see that 

(4.6) m = m{n) = maxjfc > 1 : < log n}. 

On the other hand, by (2.8) for e < e\, 

i?(e) > a r ( £) , 

so that by the converse source coding theorem, for every re > 2, 

log re > R(e n ) > a r(en ). 
Consequently, r(e n ) < m(n) and, using (2.5), this yields 
e 2 n > Y Xj + (m + l)A m+ i = Y ^3+ 

j>m+2 i>"*+l 

The assertion is also true for n = 1 since m = m(l) equals the multiplicity 
of Ai and 

oo 

e( = Y^Xj= Y X J + mA ™ - Y X i + mX m+l ■ 

j=l j>m+l ' 

Proof of Theorem 2.1. The subsequent arguments already occur 
(somewhat hidden) in Luschgy and Pages (2002). We repeat them for com- 
pleteness and the reader's convenience. By Lemma 4.1, we have, for every 

tieN, 

e 2 n <E\\X-f£\x)\\ 2 < Y X 3 +4C(l)mX m 

j>m+l 
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with m = m(n), where the approximation error is the dominating term. In 
fact, it follows from the assumption on the eigenvalues that, for defined 
in (4.5), we have ~ fc/2 as k — > oo and hence by (4.6), 

m{n) ~ 2 log n as n ^ oo. 

This yields 

Xj ~ ij)(m)~ l ~ ^(logn) -1 as n — > oo. 

j>m+l 

Moreover, 

x(p(x) = o(ip(x)~ 1 ) as x —> oo 
[cf. Bingham, Goldie and Teugels (1987), Proposition 1.5.9 b] and thus 

tfllX-Z^POH^Qogn)- 1 asrwoo. 
The lower estimate 

e\ > ip(}ogn)~ l as n — > oo 
follows from Lemma 4.2. □ 

Now we turn to the proof of Theorem 2.2. Let Q(d) denote the quantiza- 
tion coefficient (of order 2) of the d-dimensional standard normal distribu- 
tion M(0,I d ), that is, 

(4.7) Q(d)= lim n 2 / d e n (N(0,I d )) 2 

n — »oo 

[see (1.3)]. 

Proposition 4.3. The sequence (Q(d))d>i satisfies lim d ^ 00 Q(d)/d = 

1. 

PROOF. See Graf and Luschgy [(2000), Proposition 9.5]. □ 

The key property is the following d-asymptotics of the constants C(d) 
defined in (4.4). 

PROPOSITION 4.4. The sequence {C(d)) d >i satisfies \mim.i d _ iOQ C(d)/d = 1. 

Proof. Since C(d) > Q(d) for every d £ N, it follows from Proposi- 
tion 4.3 that 

(4.8) i imin f£M>i. 
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Again by Proposition 4.3, the converse inequality is true if C{d) = Q(d) for 
all but finitely many <i's. So assume that C(d) > Q{d) for all members in a 
subsequence of (C(d),Q(d))d- (No special notation for subsequences is used.) 
Set e n {d) :=e n (Af(0,I d )) and 

If for d € N, C(cf) > holds, then choose 77 > such that C(d) > Q(d)+r). 
By (4.7), there exists ko £ N such that 

sup k 2/d e k (d) 2 <Q(d) + V . 

k>k +l 

Consequently, C(d) = sup k<k() k 2 ^ d e k (d) 2 and hence, there exists p(d) € N 
such that 

^± = A(d,p(d)). 
We claim that for every sequence (k(d))d in N, 
(4.9) limMA(d,k(d))<l. 

d— >oo 

The proof of (4.9) which settles the proposition is given by a sequence 
of steps. 



Step 1. Assume 



lim . nf logfc(d) =0 

d— >oo d 



By taking a subsequence, we may assume that lim^oo log ^ rf ^ = 0. Using the 
rough upper bound 

e k (d)(d) 2 < ei(d) 2 =d, 

one gets 

A(d,k(d)) <k{dfl d . 

Consequently, 

liminf A(d,k(d)) < lim k(d) 2/d = 1. 

d-^oo d— >oo 

Step 2. For S > and e E (0, 1), consider the special sequence 

(4.10) k(d) = [exp(d(6 + Ri(e)))), 
where R\(e) denotes the e-entropy of A^(0, 1) given by 

(4.11) i?i(e)=log(l/e). 
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The direct part of Shannon's source coding theorem says that 

,. e-k{d){d) 2 2 
limsup — < e 

d—>oo O 

[see Dembo and Zeitouni (1998), Theorem 3.6.2]. A careful reading of the 
proof shows that their large deviation approach also works for the un- 
bounded (squared) error function in our setting. Since lim^oo k(d) 2 l d = 
(1/e) 2 exp(2<5), one gets 

(4.12) limsup A{d, k{d)) < exp(25). 

d— +oo 



Step 3. Assume 



rlOgfc(<0 

< hmmt < oo. 

d—ioo a 



By taking a subsequence, we may assume that 

log k(d) 

hm = c with < c < cxd. 

d-^oo d 

Choose c\ E (0, c) and 6 £ (0, c\). Then for d large, IgiMfS > Cl anc j hence 

k(d) > exp(dci) = exp(d5 + d(c± — 6)). 
Set e := exp(6 — c\) and 

q(d) := [exp(d(5 + Rx (e)))]. 
Then for d large , k(d) > q{d) and 

A(d,fc(d)) < ^^(d) 2 = M|^(d,<z(d)). 



By Step 2, we have 



limsup v4.(d, g(d)) < exp(2<5). 

d-^oo 



Since lim^oo k(d) 2 l d = exp(2c) and lim^oo q{d) 2 l d = exp(2ci), one obtains 
limsup ,4(d, k(d)) < exp(2(c - c\) + 26). 

d—*oo 

Letting 6 — > and then ci — > c yields 

limsup,4(d, fc(d)) < 1. 
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Step 4. Assume 

logfc(d) 
hm = oo. 

d— >oo d 

Fix m € N and proceed by a block-quantizer design consisting of d blocks of 
length m for quantizing M(0,I m d)- Set 

s = s(d):=[k(md) 1/d }. 

Then s d < k(md) and 

ek(md){md) 2 < e s d(md) 2 < de s {m) 2 . 
Consequently, for every d G N, 

A(rod,fc(md)) < A;(md) 2 / md e s (m) 2 - = f M^^I V ^"Wm) 2 -. 

m \ s / m 

Since s(d) — > oo as d — > oo, it follows from the Zador theorem that 
Jim s{d) 2 / m e s{d) (m) 2 = Q(m) 

[see (4.7)]. This implies 



Q(m) 

liminf A(md, k(md)) < 



d^oo m 

Using Proposition 4.3, we deduce that 

liminf A(d,k(d)) < 1. 

d— >oo 

Remark 4.1. We emphasize that Step 4 of the above proof is not in 
the range of the Shannon theory. 

Proof of Theorem 2.2. By Lemma 4.1, we have, for every d, n e N, 
e 2 n <E\\X-ffHx)\\ 2 < J2 ^+£ /d C{d)mv m 

j>md+l 



with m = m(n,d). Setting 



k. " k ^ 



a k (d):=-log\^J[ufj /4y 
we see that 

m(n, d) = max{/c > 1 : a/.(d) < logn}. 
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The assumption on the eigenvalues implies dk{d) ~ bdk/2 as k — > oo and 
hence, for every d 6 N, 

21ogn 

m(n,aj~ — — — as n — > oo. 

Consequently, 

-6 



~ A md ~ Q j ip(\og n) , 
m,dv m ~l-j V(logn)^ 1 



and 

£ *i ^ ^(logn) 



as n — > oo. 



j>md+l 

We deduce that, for every d e N, 

E ||x-^(x)f<(|) s - 1 (JL + ^)«io g „ ) - 

(4.13) 

as n — ► oo. 

Note that for d=l, (4.13) gives the desired upper estimate for fn \ Now it 
follows from Proposition 4.4 that 

6-1 

el < ( r ) t- 



The lower estimate 

/ b\ b ~ 1 b 
is a consequence of Lemma 4.2. □ 



Finally, we prove Corollaries 2.3-2.5. 



Proof of Corollary 2.3. Let p\ > p2 > ■ ■ ■ > denote the nonzero 
eigenvalues of the covariance operator of P*V and let d := dimsupp(V). 
Then, by the minimax characterization [see (3.8)] of eigenvalues, for every 

Pj+d'- V I'r 

Regular variation of the eigenvalues Xj implies pj ~ Xj as j —> oo. Let /ii > 
^ 2 > . . . > denote the nonzero eigenvalues associated to W. Theorem 2 in 
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Ihara (1970) and regular variation of pj imply that pj ~ pj as j — > oo. Thus 
the assertion follows from Theorems 2.1 and 2.2. □ 

PROOF of Corollary 2.4. By Theorem 4.12 in Luschgy and Pages 
(2002), we have 

b- 1 



with the function ifi from Theorem 2.2. Combining this with Theorem 2.2 
gives 

ip(R(e n )) ~ ip(logn) as n — > 00. 

There exists a function tp which is regularly varying at infinity of index 1/(6 — 
1) such that 

ip(ifj(x)) ~ x as x — > 00 
[cf. Bingham, Goldie and Teugels (1987), Theorem 1.5.12]. Hence 
R(e n ) ~ ^(V'(^( e n))) ~ ^P(ip(^ogn)) ~ log?i as n — > 00. 
In particular, 

]ogN(e)~R(e N{e) ), 

logiV(e) - log(JV(e) - 1) ~ R(e N(eyi ) ase^O. 

Since e < ejv( e )-i for e < e2 and e7v( £ ) < £ and thus -R(e) > i?(e/v( £ )-i) and 
i?(e) < R(&N(e))^ we obtain 

logiV(e) ~i?(e) ase^O. 

Using Theorem 2.2, this implies 



£2 ~ e ^( £ ) ~ 



(2) &3T^ e) ) ase ^°- 



Consequently, 
(4.14) 

5 \ V(6-l) 



/ 5 

( — yJ i/>(e ) as e^O, 



2 \6- 1 

and therefore R is regularly varying at zero of index —2/(6— 1). Finally, 
by (2.8), R(e n ) ~ a r (e n ) ~ r(e n )b/2 as n — ► 00 with from (4.5) and thus 

2 log n 

r(e ri )- — asn^oo. □ 
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Proof of Corollary 2.5. For every n G N, c G (0, 1), we have 

e„>cF-(l„g( T ^)) 

[see Dereich, Fehringer, Matoussi and Scheutzow (2003) or Graf, Luschgy 
and Pages (2003)]. Consequently, 

F^— ^<log^- 2^~l°§ n as n^oo. 

By Corollary 2.4, this implies 

F (^) < F (^)< log /2(e) 

and thus 

F(e) ^(c^cr 2 ^ 6 - 1 )/^) ase^O. 
Letting c — > 1 yields the assertion. □ 

Acknowledgment. We wish to thank Bianca Kramer for doing some com- 
putations. 
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